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I. INTRODUCTION 


A. PROBLEM STATEMENT 

It is imperative that today’s Army and the Army of the future be lead, managed, 
and coached by the best and most qualified General Officers that the Army can 
provide. To select those best individuals for the top Army positions requires that the 
most appropriate criteria be used in the selection process. The set of Brigadier General 
selection criteria needs to be determined. Furthermore, the determined set of criteria 
should be compatible for use with a new executive decision support system, presently 
being implemented. The objective of this study is to enhance-the existing selection 


process. 


Ց BACKGROUND 

In 1986, the Management Support Division (MSD) of the United States Army 
Military Personnel Center (MILPERCEN), based upon general concerns of the Army 
Chief of Staff, approved a study to assist the Army in selecting the most qualified 
Colonels to become General Officers. 

Each year approximately 2000 records are prepared by the Colonel’s Division, 
MIBDERCEN, for Bd by the Brigadier General selection board. The board 
examines all of the eligible files and selects approximately 200 for further deliberation. 
This group of files is refered to as the “short-stack”. The short stack must further be 
reduced to select about 60 new generals. The officers who are in the short stack files 
are all excellent and probably have flawless files. To differentiate between the files 1s 
difficult; therefore, selection of the best qualified colonels is extremely difficult. To 
insure that the basis for the decision is sound, the most appropriate underlving criteria 
must be determined and used in the process. 

Although by definition General Officers are to be generalists in the scope of their 
duties, the future of growing technologies and increased requirements placed on 
General Officers may require some degree of specialization. It is important to 
remember that the overall quality of the officer is most important when selecting a 
General Officer. The human-side of the officer should be considered above all during 
the selection process. The present system provides for the best qualified Colonels to be 


selected for Brigadier General. It is assumed that these General Officers are then 


placed into job positions (billets) for which they are individually best qualified. Once 
selected, General Officers are assigned to positions with the aid of a management 
support system. The General Officer Management Office (GOMO) maintains the 
system which tracks fifty-six comperencies or skills possessed by individual General 
Officers, as well as those required by a particular position. The competencies include a 
wide range of technical skills and areas of expertise. This optimizes the placement of 
General Officers into billets for which they are most qualified. 

To aid the selection board member with the difficult selection decisions, an 
executive decision support system called the Selection Board Support System (SBSS) is 
being implemented. The task of this thesis is to identify the Brigadier General selection 


criteria to meet the Army's requirements, congruent with SBSS. 


C. OVERVIEW OF THE SELECTION BOARD SUPPORT SYSTEM (SBSS) 

The goal of the Selection Board Support System (SBSS) is to enhance the 
selection process by providing a tool to selection board members to aid in their 
decision making. The tool, SBSS, uses multivariate decision analysis techniques to help 
structure an individual board member’s evaluations. This maintains greater consistency 
across the evaluations of a particular board member. Tests have shown that a 
selection board using SBSS can replicate the final selection list with a 97 percent 
reliability. In addition, the system detects subtle differences between candidates. 

Five criteria have been determined by which to evaluate the candidates eligible 
for selection. Those criteria are: 

e Physical Readiness and Military Bearing 

e Duty Performance 

e Military Education 

e Civilian Education 

e Officer Qualification 
Every selection board, through the grade of O-6, will use those criteria. During the 
selection process, each board member assigns his or her own weights to each criteria, 
representing the relative importance of the particular criteria. This is done through a 
pair-wise comparison of the criteria. 

Every board member explicitly scores each of the candidates on each of the 
criteria. SBSS then calculates a TOPSIS (Technique for Ordered Preference by 
Similarity to the Ideal Solution) score to produce that voting member’s rank order of 


the eligible officers. TOPSIS is a mathematical procedure developed at Kansas State 


10 


University in the late 1970's for multiple attribute decision making (MADM). It is a 
rank ordering method where N number of criteria are used to evaluate M number of 
alternatives (candidates for selection). The concept states that the most desirable 
alternative should be closest to the ideal solution and furthest from the worst-case 
negative ideal solution. Euclidean distance is calculated to measure the distance 
between each alternative and the ideal or negative ideal solution. The relative closeness 
to the ideal solution determines the preference order of the alternatives / candidates. 
[Ref. 1: p. M10] 

= _ The board members’ individual rank orders are then combined into a single order 
of merit list (OML) using a Borda scoring technique. This technique is scale invariant 
and is not affected by board members having different scoring means or variances. A 
candidate’s Borda score is calculated by a simple sum of his order of merit sequence 
numbers from each board members’ OML. The overall Order of Merit List is 
preference ordered by lowest Borda score. [Ref. 1: p. M2] 

The capabilities of SBSS provide the opportunity to utilize the support system for 
a varying number of criteria. The number of criteria for evaluation can range from 
two, considered as ‘low power’, to ten, which provides the greatest resolution. For 
initial screening and evaluation, the low power mode is sufficient to identify significant 
differences among candidates. The high power mode is implemented for the difficult 
decisions such as those candidates near a OML cut line or, in the case of BG 
selection, those Colonels whose files are selected for the short-stack. 

In November 1985, The Army Vice Chief of Staff directed that SBSS be 
implemented, especially for the rough selection decisions. Since Brigadier General 
selection is one of the most difficult selection decisions, SBSS will be used to assist in 
this process. The question arises as to the appropriateness of the above mentioned 
criteria when applied to the Brigadier General candidates. For example, most General 
Officer candidates will have attended a senior service school, so the military education 
criteria may not be an appropriate criteria/discriminater. There may be more 
appropriate criteria and attributes by which to evaluate the Colonels eligible for Brigadier 


General. 


D. THESIS OBJECTIVES, METHODOLOGY, AND OUTLINE 
The first major objective of this thesis was to determine whether a set of more 
appropriate criteria for Brigadier General selection, different from those utilized for 


grades thru O-6, could be obtained to use with SBSS. Assuming that a set of criteria 
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could be developed, the second objective was to determine the most appropriate 
criteria. Inherent in this determination was the analysis of selection attributes as well 
as those required for particular job positions. No preconceptions existed regarding the 
results which this study should provide. 
The steps used in forrnulating conclusions were as follows: 

1) Define the problem 

2) Determine the method by which to solve the problem 

3 Develop an analysis plan to support the solution methodology 


4) Develop a data collection instrument which would support and obtain data for 
the analysis plan 


5) Analyze the data 
6) Draw conclusions and suggest recommendations | 
The thesis format follows from the methodology outline. In Chapter II, the 
development of the data collection instrument is explained. Chapter III presents the - 
analysis plan, followed by Chapter IV which discusses the data analysis and explains 
the results. Chapter V includes the the conclusions and recommendations. 
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II. DATA COLLECTION INSTRUMENT DEVELOPMENT 


This chapter presents the development of the data collection instrument. First, 
the background research interviews are discussed. Second, the choice of the sampling 
population is justified. Next, the development of the questions and construction of the 
questionnaire are addressed. This is followed by an explanation of the survey approval 
process and the test of the data collection instrument. Finally, the support agencies 


are noted. 


A. GENERAL 

Initial research on the topic of General Officer selection criteria and position 
requirements revealed several related current studies addressing similar subject matter. 
The Hay Group, in their study of General Officers and Senior Executive Service 
addressed General Officer position requirements versus SES position requirements 
[Ref. 2.] The Army Research Institute has completed several studies on senior 
leadership, which discuss leadership characteristics and requirements for grades O-9 
and O-10 [Ref. 3.] None of these studies specifically addressed selection criteria nor did 
they address Selection Board Support System utilization of the criteria. Existing data 
bases did not provide the necessary information for meeting the objectives of this 
thesis. For this study, data indicating the attribute required for selection to Brigadier 
General needed to be gathered. It was-decided that the best method to insure data 
accuracy and proper data application was to develop a specific questionnaire for 


selection criteria data collection. 


5. BACKGROUND INTERVIEWS 

Prior to designing the survey questionnaire, interviews were conducted with 
representatives of several agencies in order to develop a better understanding of the 
selection process and to determine the most effective method of acquiring the necessary 
information. 

The Secretariat for Department of the Army Selection Boards is responsible for 
conducting most centralized selection boards for the Army. Interviews with the 
Secretariat's representatives vielded insight to the selection procedure. Selection 


“procedure” is the term connoting the method used during a particular selection board. 
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This is in contrast to the term, selection “process”, which connotes the entire system of 
selecting an individual for promotion. The Secretariat representatives assisted in 
providing an understanding of the present selection procedure, prior. to the 
implementation of SBSS. Currently, each selection board member evaluates the file of 
every eligible officer. He or she assigns a single value, 1 thru 6, including a plus or 
minus, to each file. This score represents the total evaluation of a candidate by a 
board member. The members then prioritize the candidates for selection by developing 
an order of merit list from these evaluations. The Selection Board Support System 
greatly enhances these current procedures. 

The Force Plans Branch of the Office of the Deputy Chief of Staff for Plans, 
MILPERCEN, provided information on the design, development, and implementation 
of SBSS, as well as the SBSS selection procedures discussed in chapter one. In 
addition, they established a base of knowledge and recommended numerous agencies to 
contact in order to expand that base. | 

The Colonel’s Division, MILPERCEN, is responsible for maintaining all 
colonels’ files. A representative described the preparation of the approximately 2000 
colonels’ files for review by the selection board. The content of a typical file which the 
selection board picks for the 200 file short-stack was discussed. Typically, a colonel 
whose file is in the short-stack has held a brigade level command, has attended a senior 
service school, and has held a key O-6 staff position. (This does not mean that 
someone without those specific qualifications could not be selected for the short-stack.) 
Evaluation reports are exemplary and all files in the short-stack would appear flawless. 

Representatives of the General Officer Management Office (GOMO) provided 
great insight into the ways and means by which General Officers are managed. 
General Officer selection boards are held through the grade of O-8. Lieutenant 
General and O-10's are not selected through a board process. During General Officer 
selection, a “floor” is placed on the board for the selection of particular specialties. In 
other words, provided an individual is fully qualified to become a General Officer, a 
board may select a colonel who has a lower order of merit listing to insure meeting a 
specialty requirement. The impact, influence, and importance of a board member 
possessing personal knowledge of a candidate was discussed with the GOMO. The 
general conclusion was that personal knowledge does impact on selection boards and 
that a degree of personal knowledge is appropriate when selecting a General Officer. 


An officer’s reputation and belief that a person will represent the Army well, are 


important General Officer selection considerations. The assignment process of an 
individual selected for General Officer was also conveyed, to include the notification 
time of billet vacancies and a description of the new management support system. 
Brigadier General job descriptions and the requirements for every BG billet were also 
obtained thru this office. In addition, the GOMO provided contact with the consulting 
firm, Hay Associates. That firm has surveyed all General Officers and Senior 
Executive Service personnel to determine proper SES/General Officer billet allocation. 
The firm provided insight into the General Officer population and a detailed review of 
current job requirements. | 

The final agency contacted was the Army Research Institute for the Behavioral 
Sciences and Social Sciences (ARI). Although many of their studies are mainly in the 
area of behavioral science, their research reports, “Senior Leadership: Requisite Skills 
and Developmental Processes For Three- and Four-Star Assignments” and “Senior 
Leadership Performance Requirements at the Executive Level", provided good research 


material for the development of questionnaire materials. 


C. POPULATION SELECTION 

The first step in developing the questionnaire was to determine the information 
required to be extracted from the gathered data. Information concerning General 
Officer attributes, position requirements, and relative importance of selection criteria 
was necessary to properly complete this study. The next issue was who should provide 
the required information. The decision was made that the persons best qualified to 
access the attributes required of a General Officer, as well as those requirements of 
General Officer positions, are the General Officers themselves. 

The population selected for survey was the collection of all Brigadier and Major 
Generals. This group has the most recent, first-hand knowledge of the demands placed 
upon Brigadier Generals and could therefore be a good judge of the necessary 
attributes. Inclusion of both the Brigadier and Major Generals provided two 
"treatments" for the questionnaire. The Brigadier Generals provided feedback on their 
own current positions and the current demands placed upon them. It provided for an 
introspective analysis of the Brigadier Generals as a group. In addition, surveying ail 
of the Brigadier Generals would allow the development of a data base which included 
all current BG billets. A survey of the Major Generals would provide for a supervisory, 
.top-down, view of the required BG attributes. Their responses would provide an 


external assessment of the Brigadier General criteria. Combining both viewpoints 
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would give a more complete data base for analysis. Furthermore, a comparation of the 
two would show if there was a substantial difference of opinion between those 
currently serving as Brigadier Generals and those who oversee them. The General 
Officer Management Office approved the administration of the survey to this 
population of General Officers. 

One major goal of the survey was to insure the questionnaire was geared for the 
sample population. The Brigadier and Major General populations were relatively 
small, and each position unique. Therefore, we needed to insure the maximum possible 
response to the survey. Realizing this limitation and recognizing the time constraints 
placed upon General Officers, the survey length was kept to a minimum. Questions 
were written in an executive style; developed to extract the maximum information in 
the least amount of words. The questions were moderately spaced on each page and 
the total survey packet restricted to five pages to encourage a higher likelihood of 
response. In addition, the time required to complete the survey was tested. The fifteen 
minute completion- time requirement was clearly indicated on the cover page. The 
survey was designed for the population; developed to minimize the time requirement 


placed on the General Officers, and insure the maximum response rate. 


D. QUESTION DEVELOPMENT AND SURVEY CONSTRUCTION 

The survey questions had to insure that proper, adequate, and useful information 
was obtained for analysis. Questions were developed from mainly three sources: 
General Officer billet / job descriptions, current SBSS criteria, and background 
interviews. 

The General Officer Management Office maintains approximately twenty binders 
containing the descriptions, requirements, and characteristics of all General Officer 
billets, including 205 Brigadier General positions. To develop the criteria to be 
evaluated on the questionnaire, the position requirements for each BG billet were 
analyzed. Each description contained a position summary and position analysis 
consisting of prioritized criteria and their applications. The listed criteria were of a 
general nature and standardized across the positions. Therefore, a more inclusive list 
of criteria was developed from analyzing the applications. A record of the criteria for 
each billet was maintained and multiple occurances of the same or similar criteria were 
summed across all of the descriptions. Criteria which were similar in nature were then 
grouped together. For example, some positions required medical, legal, specialized 


engineering, scientific expertise, or branch specific expertise. These criteria were 
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grouped into one criteria category, “technical expertise”. The final criteria to be 
evaluated on the survey were selected by determining those criteria or categories with 
the highest density across the Brigadier General billets. Subjectively, the criteria were 
selected to maximize the coverage of all General Officer responsibilities. 

Additional criteria were developed by reviewing the SBSS documentation. Since 
an earlier study group had determined five criteria for use on the selection boards 
through O-6, those criteria were selected to be evaluated by the General Officer 
population. This provided data to determine whether the existing criteria were 
appropriate for General Officer selection. 

Two survey questions listed the criteria to be evaluated. The General Officers 
were requested to evaluate the criteria for the relative importance for selection and 
then again requested to evaluate the identical criteria for importance for job 
performance. Evaluation of the identical criteria for these two questions would provide 
data for comparison of selection criteria and job performance criteria. These questions 
were worded to elicit responses on a scale of 1 thru 7, with 1 labeled as “slightly 
important”, 4 labeled as “moderately important”, and 7 labeled as "extremely 
important”. This coding was used to attempt to create a spread across the range of 
numerical values. The scale purposely did not include a “not important” label since all 
the criteria were developed from General Officer requirements. The survey was 
developed insuring that all criteria were rated on the same scale. Rating all criteria on 
the same scale would provide ease of comparison between and among criteria during 
the data analysis. 

In addition to the criteria developed from the billet descriptions and the SBSS 
documentation, several criteria were listed to insure the validity of the responses. 
Several criteria, which when evaluated, should have a high correlation with another 
criterion were embedded into the two questions. For example, although “tactics” and 
"strategy" are not the same, there should be a relatively high correlation between the 
two. Strategy was added to the criteria list to check for consistency in a response. 
This was also done by adding the criterion, "Plans, Program Budgeting System 
(PPBS)', to check for correlation with "program management" and "acquisition". 

A total of twenty-six separate criteria were listed for General Officer evaluation. 
The first Criterion listed on the two questions was “time in service”. The purpose of 
placing this criterion up-front was to cause the population to think of using the low end 


of the rating scale and avoid inflated responses. (We believed that “time in service” was 
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of slight importance for selection and job performance; however, responses indicated 
differently.) An additional criterion named “other” was included at the end of the list 
to allow the General Officers to submit a broader response if they felt an important 
attribute was omitted from the questions. 

The remaining survey questions attempted to gain insight into the survey 
population itself. Demographic questions included: time in grade, civilian education 
level, former branch or specialty, and current position. Additional questions queried 
the General Officer’s selection board experience. They were asked to indicate the 
number of officer selection boards on which they have served. Another question asked 
if the General Officers have previously served on a Brigadier General selection board. 
The background interviews resulted in a question concerning the importance of 
personal board member knowledge of a candidate. 

Finally a set of questions regarding the Brigadier Generals’ preparedness for their 
assigned positions rounded out the questionnaire. Brigadier Generals were asked to 
evaluate how well prepared they were for their first General Officer position and 
subsequent position. They also evaluated the appropriateness of their first position to 
their individual career backgrounds. Major Generals were asked to comment on the 
preparedness of a Brigadier General which he or she supervised. 

All survey questions were designed to obtain the maximum information requiring 
the minimum effort by the survey population. Each question supported the proposed 
analysis plan. Appendices A and B respectively contain copies of the Brigadier General 


and Major General surveys. 


E. SURVEY APPROVAL PROCESS 

All surveys which address Army issues and personnel are required to receive 
approval from the Survey Branch of the U. S. Army Soldier Support Center (National 
Capital Region). In addition, since this survey was being administered to General 
Officers, it also needed the approval of the General Officer Management Office. To 
insure a high response rate and convey the importance of the survey, the signature of 
the Deputy Chief of Staff for Personnel was sought for the accompanying cover letter. 

An initial analysis plan, along with a draft survey was submitted to the Survey 
Branch for approval in December 1986. Survey Branch personnel reviewed the 
documents, insured that the survey supported the analysis plan, and made minor 
changes to the questionnaire. Their tendency was to lengthen the explanation of the 


survey questions to insure that each question would be understood. Reinforcing the 
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idea that we were surveying a specialized population, allowed the survey to be 
approved in its existing brief, executive style form. The survey received final approval 
in January 1987 and survey control number, ATNC-AO-87-05, was assigned. A copy 
of the survey was submitted to the GOMO. Approval was received with no additional 
changes. 

The final step of the approval process was to obtain the signature of the 
DCSPER, LTG Elton. A survey cover letter was drafted (appendix C) and the project 
was briefed to LTG Elton by the chief of the GOMO. It received auto-pen approval 
on 5 February 1987. 


F. TEST OF SURVEY 

Prior to the final survey approval, the collection instrument was tested. Due to 
the small survey population, the test population was limited to seven General Officers. 
The Generals selected for the test represented a variety of General Officer billets and 
consisted of both Brigadier and Major Generals. 

The responses from the test cases were encouraging. Comments by the Generals 
were interesting and helpful. Only a minor wording change was required on one 
question; the remaining questions appeared to be understood by all participants. 

The test data were compiled and found to be useable when analyzed according to 


the analysis plan. 


G. SURVEY SUPPORT 

Publication and distribution of the survey questionnaire required the support of 
several offices. The GOMO was instrumental in obtaining approval and signatures on 
the cover letter. In addition, they printed the cover letter, provided General Officer 
mailing labels, and performed a mail-merge of the letters and labels. The Naval Post 
Graduate School print shop printed and collated the surveys. Survey responses were 
routed through the Force Plans Branch, MILPERCEN, for immediate forwarding to 


the Naval Postgraduate School for analvsis. 
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111. ANALYSIS PLAN 


The purpose of the analvsis plan was to insure the objectives of the thesis were 
met. It was designed concurrently with the survey and provided a systematic method 
for data analysis. ۱ | 

To obtain an understanding of the data set, an exploratory analysis was 
scheduled as the first step of the analysis plan. The exploratory plan commenced with 
univariate descriptive procedures and progressed to multivariate analysis. Both 
graphical and non-graphical analysis of the means, frequencies, distributions, and 
correlations were to be included in this step. í 

Next, Analysis of Variance (ANOVA) techniques were planned in order to test 
the hypotheses that the means between the demographical treatments were equal. 
Tests were included to determine whether the respondents’ civilian education level, 
rank, selection board experience, or career background had significant influence on the 
population’s evaluations. 

The plan then required a more advanced statistical technique to actually extract 
the most appropriate selection criteria. For the selection criteria data, a principle 
component analysis (PCA) was planned in order to reduce the dimensionality of the 
problem as well as determine the number and strength of the principle components 
actually present for selection. Using principle components the study would determine 
if there exists a set of underlying, meaningful, composite variables which would explain 
aggregated characteristics of the original selection variables. 


A subjective analysis of General Officer comments concluded the analysis plan. 
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IV. ANALYSIS OF DATA 


This chapter discusses the input of the response variables and the analysis of the 
collected data. First, the survey administration and data preparation are discussed. 
Exploratory data analysis, to include analysis of means, standard deviations, and 
frequencies is next developed. The exploratory analysis is followed by discussion of 
analysis of variance procedures and bivariate analysis.. Several variable reduction 
methods to include principle component analysis and variable cluster analysis are 
developed. A brief comparison analysis of selection criteria and job performance 
criteria concludes the numerical analysis. Finally, a subjective analysis, based on the 


General Officers' written comments, closes the chapter. 


A. GENERAL 

The analysis documented in this chapter follows the analysis plan developed in 
chapter three. Additionally, subsequent to the analysis plan development, it was 
decided that the variable reduction technique, variable cluster analysis, was required. 
Computational hardware resources used for the analysis included an IBM 3033 System 
370 mainframe computer. The MVS batch system was used to process analvsis 
requirements. The choice of software was based upon current assets and capabilities of 
the U. S. Army Military Personnel Center, as well as the power required of the 
statistical tool. All analvsis was performed using the SAS, version 5, statistical 
package. Complementing graphics were developed using the APL based, unreleased 


IBM mainframe graphics and statistical package, Grafstat. 


B. DATA COLLECTION 

The survey was administered to 349 General Officers via mail on 15 February 
1987. Throughout February and March, responses were received from 145 Major 
Generals and 186 Brigadier Generals, for a total of 331 responses. This resulted in a 
94.8% response rate. The goal of developing a survey that would insure a high 
response rate was realized. 

Of the 331 responses, only four were not used in the analysis, creating a 98.8% 
utilization rate. The inability to use those responses was due to incompleteness or 


obvious misunderstanding of questions which would cause inaccuracies in the analvsis. 
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In addition to replying to the specific survey questions, many General Officers 


included comments which displayed great interest in the study. 


C. QUESTIONNAIRE DATA 

Strictly speaking, the subjective responses to the General Officer questionnaire 
yield only ordinal scale data (except for the demographic question responses which 
yield nominal scale data). Consequently, only statistical procedures that require 
counting and ranking of the data are justified theoretically. However, we believe that 
the nonparametric techniques available for analyzing ordinal data are not rich enough 
to support the kinds of analyses that are necessary for anyalyzing this data. 
Parametric techniques should be performed on the data. 

Interval data is required to justify much of the parametric analysis which is 
proposed. Interval data have an equality of unit over different parts of the scale in 
addition to an ordering. We believe that the subjective scales used for the General 
Officer questionnaires have some degree of numerical information. To consider only 
the rank order characteristic of the data would ignore this important information. 
Thus, the data statistically represent an ill-defined middle ground. We believe that the 
parametric techniques can and should be performed on the questionnaire data. In 
addition, each technique is a well established statistical procedure and each 1s generally 
robust with respect to departures from the strict assumptions under which they were 


originally derived. 


D. DATA PREPARATION 
The data variables developed from the survey responses fall into three categories: 

e Background and demographic variables 

e Selection criteria variables 

Փ Job performance variables 
Based on this intuitive division of the response variables, a SAS formated input file was 
created and the variables were divided into three formatted records. Each data point 
was manually input to the SAS data file and then verified to insure the quality of the 
data entry. Several surveys included individual, unanswered questions, thus creating 
missing data values. SAS identifies these missing values by use of a period ”.” . Unless 
otherwise specified, missing values were omitted from all statistical computations, thus 


maintaining accuracy. 
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1. Demographic and Background Variables 

In order to perform a quantitative evaluation, several demographic response 
variables were recoded from the questionnaire. 

The General Officers’ ranks were input in two different manners. The first 
variable divided the responses into two treatments. The variable, “TREAT”, recoded 
the responses as nominal values, | or 2, corresponding to Brigadier Generals and 
Major Generals respectively. The variable, “RANK”, further categorized the rank 
information to include promotable status. The responses were recoded as a nominal 
variable with values, 1, 2, 3, 4, respectively representing BG, BG(P), MG, and MG(P). 

The variable, “TIG”, represents the time-in-grade for a General Officer. These 
values Were transcribed directly from the responses and did not require recoding. 
Likewise, the General Officers’ former specialty codes and functional areas / secondary 
specialties were input directly from the survey responses and the representative 
variables are named “SC” and “FUNCAREA” respectively. 

The variable, “CIVED”, represents the General Officers level of civilian 
education. Again the responses were recoded as nominal values. A BS/BA level degree 
is represented by the value "1". A MS/MA level degree (to include MBA) is recoded as 
the value “2”. A PhD degree is assigned a value “3”, and the "other" category is 
assigned the value "4". The “other” category includes medical degrees (MD, DDS, etc.) 
and law degrees (LLB, JD). 

The next two variables represent a respondents experience with selection 
boards. The variable, “OFFBD”, represents the number of officer selection boards 
served on by a respondent. Service on nine or more boards were aggregated into a 
single category; therefore, values range from 0 to 9. The variable, “BGBD”, is a binary 
variable indicating whether or not a General Officer had previously served on a 
Brigadier General selection board. The values O or 1 were used to represent the 
responses “no” or “ves”, respectively. 

The remaining background questions were evaluated on a scale of one thru 
seven (with seven indicating a strong score). The values were transcribed directly to 
the data set. The variable, “PERSKNOW”, represents the importance of a board 
members personal knowledge of a General Officer candidate. The variable, 
“FIRSTPSN”, results from a question asked of Brigadier Generals. It queried how well 
prepared they were for their first General Officer assignment. The variable also includes 


data from a similar question asked of Major Generals, asking them to evaluate the 
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preparedness of a new Brigadier General subordinately assigned. The variables, 
“SUBSQPSN” and “APPROPSN” were developed from questions asked only of 
Brigadier Generals. SUBSQPSN represents how well a BG was prepared for a 
subsequent General Officer assignment. For those Brigadier Generals currently serving 
in their first General Officer position, the SUBSQPSN variable was entered as a 
missing data value. The variable, "APPROPSN', represents the appropriateness of a 


Brigadier General's first position as compared to his or her career background. 


All record one variables are summarized in Table 1. 


TABLE 1 


SUMMARY OF DEMOGRAPHIC AND BACKGROUND VARIABLE 


VARIABLE 


TREAT 
RANK 


TIG 


SC 
FUNCAREA 


CIVED 


OFFBD 


BGBD 


PERSKNOW 


FIRSTPSN 
SUBSQPSN 


APPROPSN 


DEFINITIONS 
DESCRIPTION 


Rank Treatment for BG or MG 


Ranks to include promotable . 
status BG, BG(P), MG, MG(P) 


Time in Grade 


Former specialty code 


Former functional area 
or secondary specialty 


Civilian education level 
(Bachelors, Masters, Phd, Other) 


Officer selecuon board experience 
(Number of selection boards) 


Brigadier General selection 
board experience (No or Yes 


Importance of بت‎ 
board member knowledge 
of a candidate 


Preparedness for first, 
General Officer position 


Preparedness for subsequent 
General Officer positions 


Appropriateness of first 
position to career background 
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POSSIBLE VALUES 


2ا 

د 2 12 

Actual time 
(an months) 
Code Number 
Code Number 


1,2, 3,4 
0 thru 9 
0, 1 


Itiu 7 


1 thru 7 
] thru 7 


1 Լուս 7 





2. Selection Criteria Variables 
Record two variables are summarized in Table 2. Each variable represents a 
single selection criterion and is valued on a discrete scale of one thru seven. The data 
values were transcribed directly from the questionnaire with the value of 7 indicating a 
criterion to be extremely important and a value of 1 describing a selection criterion to 


be slightly important. 


3. Job Performance Variables 
Record three variables represent the job performance criteria and are also 
summarized in Table 2. Values and variable meanings are identical to those for the 
selection variables. A "1" has been placed as a suffix to the variable name to 


distinguish the job performance variables. 


E. UNIVARIATE ANALYSIS OF SUMMARY STATISTICS 
The analysis begins by concentrating on the basic summary statistics. This 
section explores the means, standard deviations, and numerical ranges of individual 


variable responses. 


1. Background Variable Summary Statistics 

The summary statistics for the record 1 variables are given at Table 3. 
Summary statistics for the nominal variables are omitted. The first column of the table 
lists the variable name. The column labeled “N” shows the number of observations 
(responses) for the particular variable. The next two columns provide means and 
standard deviations respectively and the last two columns indicate the range of values 
assigned to the variable. 

There are two interesting points concerning these variables. Although 
PERSKNOW has a mean of 5.598, it also has a relatively large standard deviation and 
the assigned values encompass the full range of possible values. This indicates a wide 
range of opinion concerning the importance of a board members personal knowledge 
of a candidate. 

The second interesting point shows that there is a marked difference between a 
Brigadier General's preparedness for his first and subseguent positions. The mean of 
SUBSQPSN is greater than that of FIRSTPSN. Additionally, the range and standard 
deviation of SUBSQPSN is smaller, illustrating a stronger consensus of opinion that 


the Brigadier Generals were better prepared for their subsequent positions. What this 


25 


TABLE 2 
SELECTION AND JOB PERFORMANCE VARIABLE DEFINITIONS 


SELECTION JOB PERFORMANCE 


VARIABLES VARIABLES DEFINITIONS 
TIS 1151 Time in Service 
0 7 PHYSFITI Physical Fitness and 

Miltary Bearing 

MEL _ MELI Military Education Level 
ASSIGN ASSIGNI Assignment History 
PERFORM PERFORMI Past Performance 
CIVILED CIVIEEDI Civilian Education 
RESMGT . RESMGTI Resource Management Ability 
DECISN DECISNI Decision Making Ability 
FORNREL FORNRELI Foreign Relations Skills 
PUBREL PUBRELI Public Relations Skills 
GOVTREE GOVTREU! Government Interaction Skills 
VERBCOM VERBCOMI Verbal Communication Skills 
WRITCOM WRITCOMI Written Communication Skills 
TEGHE Se 066 ٦ Technical Expertise 
INDUS INDUSI Industrial Interaction Ability 
CONCEPT CONCEPTI Ability to Conceptualize 
LEADER LEADERI Leadership 
COMBAT COMBAT! Combat Experience 
CMDPRES CMDPRESI Command Presence 
PPBS PPBS1 PPBS Knowledge 
PROGMGT PROGMGTI Program Management Ability 
TIMEMGT TIMEMGTI Time Management Skills 
TACTICS TACTICSI Tactics Skills 
ACQUIS ACQUIS1 Acquisition Skills 
JOINT JOINTI Joint Service Skills 
STRAT STRATI Strategy Skills 


Note: All variables are evaluated on a scale of importance: 1 thru 7 
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analysis does not tell us is whether the subsequent position improvement is due to 
better assignment-experience correlation, or, due to adaptation to overall requirements 


placed on a General Officer. 


TABLE 3 
BACKGROUND VARIABLE SUMMARY STATISTICS 


VARIABLE MEAN STANDARD MINIMUM MAXIMUM 
DEVIATION VALUE VALUE 


PERSKNON 5 : 1) 1.24079242 1.00000000 . 00000000 
FIRSTPSH 5.67868852 1.00412222 2.00000000 . 00000000 
SUBSQP SI 6.00000000 0.91196665 5.00000000 .00000000 
APPROPSH 6.22598870 1.07914226 2.00000000 . 00000000 





2. Selection Variable Summary Statistics 

The summary statistics for the selection variables are given at Table 4. The 
statistics depict the average importance of a particular criterion for selection. The 
means indicate that leadership, past performance, and decision making ability are 
considered extremely important. The corresponding variables have mean values greater 
than 6.7 and maintain relatively small standard deviations and ranges. 

An interesting observation is that at the time of the survey, General Officers 
evaluated the joint service criterion relatively low in companison to other criteria. This 
appears not to be in concert with the Title IV joint service requirement for General 
Officer selection. 

3. Job Performance Variable Summary Statistics 

The summary statistics of the job performance variables are given in Table 5. 
Implementation of a management support system which aids in the assignment process 
(discussed in Chapter 1) reduced the need to explore these data deeply. Moreover, a 
high correlation between job assignment and career experience was observed in the 
variable, APPROPSN, thus indicating appropriate assignment once a candidate is 


selected for BG. Therefore, the analysis concentrated on the selection variables. 
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TABLE 4 
SELECTION VARIABLE SUMMARY STATISTICS 


VARIABLE N MEAN STANDARD MINIMUM MAXIMUM 
DEVIATION VALUE | VALUE 


. 14940837 .00000000 
.90652816 .00000000 
.89712456 .00000000 
.83955749 .00000000 
.68028621 .00000000 
~ 15588243 .00000000 
. 95651562 . 00000000 
. 46680910 . 00000000 
.22799268 .00000000 
. 06905004 . 00000000 
. 2158927 . 00000000 
.66217854 .00000000 
.78410351 .00000000 
. 88470835 
. 252839409 
.88071024 
. 35386886 
. 16932639 
.90450605 
.05425571 
.16150299 
.01019345 
.1637 35491 
- 18899305 
.05046339 
.07276112 


ÉS 
PHYSFIT 
MEL 
ASSIGN 
PERFORM 
CIVILED 
RESMOT 
DECISN 
FORNREL 
PUBREL 
GOVTREL 
VERBCOM 
1 
TECHEXP 
INDUS 
CONCEPT 
LEADER 
CONBAT 
CMDPRES 
PPBS 
PROGMGT 
TIMEMGT 
TACTICS 
ACQUIS 
JOINT 
STRAT 


.00000000 
.00000000 
¿00000000 
. 00000000 
. 00000000 
.00000000 
.00000000 
«00000000 
.00000000 
.00000000 
.00000000 
.00000000 


6 
eo 
eo 
e 


.00000000 
.00000000 
.00000000 
.00000000 
.00000000 
.00000000 
.00000000 
.00000000 


موير) ير) ن] حل سر زم ون Y AR‏ سراح یں رح سو یں/) وی مر رح Y Y A‏ مر مریم مم 
o‏ 
o‏ 
o‏ 
o‏ 
o‏ 
o‏ 
o‏ 
o‏ 
له RU RJ mJ‏ ہہ ہہ یہ 


1 
0 
0 
0 
0 
1 
0 
0 
1 
1 
1 
0 
0 
0 
1 
0 
0 
1 
0 
1 
1 
1 
1 
1 
1 
1 
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F. UNIVARIATE FREQUENCY DISTRIBUTION ANALYSIS 

This section continues the exploratory analysis thru analysis of the frequency 
distributions. Analvsis of the frequency distributions adds to our understanding of the 
variables and provides a basis for the assumptions to be made in the more advanced 
analysis techniques. It provides a summary of the responses to the nominal scale 
variables. 


1. Demographic and Background Variables 

The histograms of the demographic variables depict the make-up of the 
surveyed population. Figures 4.1 thru 4.5 and Table 6 include the demographic 
frequency data. The first column of the accompanying tables lists the variable name 
and the nominal variable values (categories), as discussed in Section D of this chapter. 
The second column indicates the frequency, or number of respondents, who are 
members of the respective categories. Column three shows the cumulative frequency; 
column four states the percent of the population in a specific category. The final 


column lists the cumulative percentages. 
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VARIABLE 


د دا 
ገ ር ን 11‏ 
MEL‏ 
85511 
6 
CIVILED1‏ 
RESMGT1‏ 
DECISN1‏ 
FORNREL1‏ 
PUBREL1‏ 
GOVTREL1‏ 
VERBCOM1‏ 
WRITCOMI‏ 
TECHEXP1‏ 
INDUS1‏ 
CONCEPT1‏ 
LEADER]‏ 
1 60 
CMDPRES1‏ 
DRBSI‏ 
PROGMGT1‏ 
TIMEMGT1‏ 
TACTICS]:‏ 
ACQUISI‏ 
JOINT‏ 
STRAT‏ 


N 


0۸815 
JOB PERFORMANCE VARIABLE SUMMARY STATISTICS 


MEAN 


4.60915493 
3. 255572 
5:5598 5915 
6.18947363 
6.28421053 
4.84912231 
5. 9456 
6.63070175 
4.26315739 
5.39860140 
Գ.66901Գ08 
6.58947368 
6.28070175 
6.11267606 
4.22807018 
6.26315789 
6.65263158 
4.53684211 
5.92579505 
5.11619718 
5.073594366 
6.22807018 
4.76491228 
4.54225352 
5.03169014 
4.98591549 


STANDARD 
DEVIATION 


11755150 
15132496591 
1.08634700 
0.78221521 
0.93443315 
1.63952296 
.19608330 
.54366991 
.74144100 
. 36954263 
.6 00 
«59052265 
85822385 
. 9 
. 0 


موت نونويون ن نزير و هه 


.6729ԳԳ25 
1.58654461 
1159975 
1.48152998 
1.66303240 
0.89634516 
1.77149686 
1.70064731 
1.47621279 
1.67916316 


.90238955. 


MINIMUM 
VALUE 


1.00000000 
2.00000000 
1.00000000 
Գ.00000000 
2.00000000 
1.00000000 
1.00000000 
5.00000000 
1.00000000 
1.00000000 
1.00000000 
4.00000000 
3.00000000 
2.00000000 
1.00000000 
2.00000000 
3.00000000 
1.00000000 
1.00000000 


.00000000 
.00000000 
.00000000 
.00000000 


لہ لد لہ لہ لد لہ لہ ل ل ی لہ ل لہ لہ ل ل ل ی یہ لہ لہ یہ ی لہ یہ یہ 


MAXIMUM 
VALUE 


. 00000000 
.00000000 
.00000000 
400000000 
.00000000 . 
.00000000 

.00000000 
.00000000 
.00000000 
.00000000 
.00000000 
.00000000 
.00000000 
.00000000 
.00000000 
.00000000 
.00000000 
«00000000 
00000000 
.00000000 
.00000000 
.00000000 
«00000000 
. 00000000 
.00000000 
.00000000 





a. Treatment Distribution b 
Figure 4.1 displays the breakdown of the population by rank treatment. 
The table shows that approximately 56% of the data is based on BG responses and 


44% is based on those of Major Generals. 


b. Rank Distribution 
The variable, RANK, further divides the population’s rank structure to 
include promotable status. The categories of BG, BG(P), MG, and MG(P) are 
represented by the values 1, 2, 3, and 4 respectively. The RANK distribution is given in 
Figure 4.2. 


c. Distribution of Civilian Education Levels 

Figure 4.3 identifies the civilian education level of the General Officer 
Overwhelmingly, the majority (277 of 327) of Brigadier and Major 

Eighteen Generals, or 5.5% of the responding 


population. 
Generals hold a masters degree. 


$ 
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HISTOGRAM OF TREAT 


182 
o 
x 
145 : 

፳ 
5 TREAT FREQUENCY CUM FREQ PERCENT CUM PERCENT 
2 1 182 182 55.657 55.657 
و2‎ 2 165 327 44. 343 100:000 

8 
= 
o 
0 1 2 3 


TREATMENT (1-8G, 2-MG) 1 


Figure 4.1 Treatment Distribution. 


HISTOGRAM OF RANK 


141 


መ 


RANK FREQUENCY CUM FREQ PERCENT CUM PERCENT 


1 156 47.706 47.706 
2 7.951 352857 


26 
141 43.119 98.777 
4 1.223 100.000 


4 


1 2 3 4 
RANKS (1መ66, 2©8G(P), J=MG, 4=MG(P)) 





Figure 4.2 RANK Distribution. 
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population, maintain a bachelors degree and only 1.8% have obtained a PhD. Twenty- 


six General Officers hold specialty degrees in law medicine or dentistry. 


HISTOGRAM OF CIVED 
277 


CIVED FREQUENCY CUM FREQ PERCENT CUM PERCENT 


1 18 18 5.505 5 
277 295 84.709 90.21Գ 
501 1.835 92.049 
26 327 b. 100.000 


e 
3 
4 


LEVEL OF CML EDUCATION 





Figure 4.3 CIVED Distribution. 


d. Officer Selection Board Experience Distribution 
Figure 4.4 identifies the number of officer selection boards served on by 
General Officers. The X axis gives the number of selection boards and the frequency 
indicates how many Generals have had that level of experience. The category, “9”, is 
aggregated to reflect nine or more selection boards. The data shows that 82% of the 


respondents has had some previous officer selection board experience. 


e. Distribution of Brigadier General Board Experience 
The distribution of Brigadier General selection board experience indicates 
that the majority of the respondents had not previously served on a BG selection 
board. Only 54 of the 327 General Officers have had this experience. Figure 4.5 
displays the distribution. 


f. Career Background Distributions 
Table 6 depicts the career backgrounds of the General Officers. It identifies the 
number of General Officers responding by their former specialty codes (SC). 
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HISTOGRAM 0۴ 0 


FREQUENCY CUM FREQ PERCENT CUM PERCENT 


ኣዕ سر یتح یں د ورا 9 بل مو‎ ርጋ» 


٥ 2 8 10 
OFFICER SELECTION BOARD EXPERIENCE (NUMBER) 


HISTOGRAM OF BGBD 
273 


BGBD FREQUENCY CUM FREQ PERCENT CUM PERCENT 


0 273 275 83.686 83.486 
1 54 327 16.514 100.000 


0 1 
BG BOARD EXPERIENCE (O=NO, 1~YES) 





Figure 4.5 BGBD Distribution. 
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TABLE 6 
DISTRIBUTION BY SPECIALTY CODE 


FREQUENCY CUM FREQ PERCENT CUM PERCENT 


ኣዕ فى تي‎ 09 09 J J = J ~J NON 
տ ںزح ہر یہ‎ «ՄՔ ԿԻ ርጋ “=4 ھ‎ 


hr 
ኮን ፌ4.ራ ርጋ ርጋ ሁ።ዬዙ” ርጋ ኑ፡። ርጋ ርጋ ርጋ ር2ኑ። ር ር2 ር ኑ። ር ር2 ኮነ ር2 ርጋ ዙ”ኑ፡ ርጋ ሯ ር2 6 ርጋ ሯ ርክ ኣዐ ኮን 


1 
4 
1 
6 
6 
2 
ጉ 
4 
3 
1 
5 
3 
1 
1 
4 
1 
1 
1 
3 
4 
1 
4 
4 
1 
1 
5 
0 
ս 





Frequency distributions for the remaining variables (each with the discrete 
values 1-7) were examined primarily with an eye towards normality. The distributions 
of the variables, PERSKNOW, FIRSTPSN, and SUBSQPSWN were slightly non-normal 
being skewed toward the higher values. 

A comparison of the FIRSTPSN and SUBSQPSN distributions, indicates 
that Brigadier Generals are more prepared for subsequent positions than their first 
assignments. Both distributions are skewed toward the larger values, however. [t is 
logical that individuals feel better prepared for subsequent assignments. The important 
point is that there are several Brigadier Generals who believe they were not as well 


prepared for their first assignments as they could have been. 
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Over 92% of the Brigadier Generals judged the appropriateness of their 
first assignment, as compared to their career backgrounds to be in the top three values. 
The distribution indicates that, once selected for General Officer rank, Brigadier - 
Generals feel they are appropriately assigned. This finding allows the study to 
concentrate on determining the most appropriate selection criteria and to limit the job 
performance criteria analysis. 

The distribution of PERSKNOW shows that a board members personal 
knowledge of a candidate does play an important role in Brigadier General selection. 
Over 84% of the respondents evaluated the importance to be 5 or greater. The 
distribution analysis improves the interpretation of the summary statistic analysis. 
Further analysis to determine the effect of BG board experience on this distribution 1s 
discussed in Section H. 

Figure 4.6 displays the histograms of the variables, FIRSTPSN, 
SUBSQPSN, APPROPSN, and PERSKNOW. 


2. Selection Variable Distributions 

The majority of the selection variable distributions tend to be normally 
distributed, however they are slightly skewed toward the greater values. Six of the 
twenty-six selection variables, ASSIGN, PERFORM, DECISN, VERBCOM, 
WRITCOM, TECHEXP, and LEADER are highly skewed toward the greater values 
The strongest criterion, based on distribution analysis, is leadership. Over 87% of the 
General Officers assessed this criterion with the highest possible value, 7. Past 
performance is the next highest evaluated criterion with 81% of the respondents 
assigning the highest rating. 

Figure 4.7 comparatively displays the selection variables in a box plot. The 


histograms for each individual selection variable are found at Appendix E. 


G. ANALYSIS OF VARIANCE 
1. Introduction 

This section concentrates on the use of analysis of variance (ANOVA) as an 
investigative tool to detect differences in means among the levels of demographic 
variables. An attempt is made to explain the variation in the response as being due to 
the level classification. 

For example, using CIVED as the independent variable and one of the 
selection variables as the dependent variable, ANOVA compares the equality of the 


means of the selection variable across the levels of four education levels of CIVED. 
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Figure 4.6 Distributions of Background Variables. 
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Figure 4.7 Selection Variable Box Plot. 
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Figure 4,7 Selection Variable Box Plot. (cont'd.) 
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Figure 4.7 Selection Variable Box Plot. (cont d.) 


For the test, the null hypothesis states that the means of the selection variable 
for all four CIVED levels are equal, while the alternate hypothesis states that they are 
not. This test was performed using the variables, TREAT, CIVED, OFFBD, BGBD, 
SC, and FUNCAREA .as the independent variables. Several forms of the twenty-six 


selection variables were used as the dependent variables: 
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1) An ANOVA was performed using each selection variable as the dependent 
variable individually. This determines significant differences in General Officer 
responses for each selection variable. 


2) An “overall” measure was generated by adding the values of all the selection 
variables. This derived variable was used as the dependent variable in 
ANOVA studies to test for differences in means as a function of the 
demographic variables. Table 7 tabulates the results for the five, one-way 
ANOVAs using this dependent variable. 


3) Subsequent to the principle component analysis of the selection variables 
(Section I), an ANOVA was performed using the first principle component as 
the dependent variable. This approach was done to investigate significant 
differences in overall General Officer responses. The first principle component 
was used because it accounts for the greatest variance in all of the original 
selection variables. Table 8 gives the results for the five, one-way ANOVAs 
using the first principle component dependent variable. 

The test statistic used to reject or not reject the null hypothesis for ANOVA 1s 
the F statistic. An observed F value, larger than the selected .05 significance level F 
value, would be cause for rejection of the null hypothesis. It would indicate that there 
exists a significant difference between the means. 

The analysis of variance fixed effects model assumes that the underlying 
variable distributions are normal [Ref. 4: p.524]. The majority of the variable 
distributions are slightly non-normal and skewed toward the larger values; however, the 
ANOVA procedure is robust. To insure and check the robustness of the ANOVA 
model, all ANOVA tests were duplicated using the nonparametric, Kruskal-Wallis test. 

The Kruskal-Wallis test does not assume normality and tests the null 
hypothesis that the classification (level) distributions are identical. The alternate 
hvpothesis states that at least one of the classifications tends to yield larger 
observations than at least one of the other variable classifications. [Ref. 5: p.230] 

Both the ANOVA and the Kruskal-Walls test determine whether the 
differences between the classification (level) means are significant. The agreement 
between the two statistical tools supports the robustness of the ANOVA model in this 
study. 

2. Analysis Discussion 
Table 7 summarizes the Analysis of Variance results, as well as the Kruskal-Wallis 
results using the summed selection variable, as the dependent variable. The table's first 
column lists the independent classification variables. The second column lists the 


number of classifications or levels within the corresponding independent variable. For 
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both ANOVA and Kruskal-Wallis, the .05 08 level test statistics are listed and the 
computed/observed F and T values are indicated. The “SIG” columns indicate whether l 
a significant difference between the level means exists. As shown in Table 7, there are 
no significant differences in the level means for any of the classification variables. 
Additionally, the Kruskal-Wallis test and the ANOVA model produced identical 
significance outcomes. This analysis indicates that overall General Officer responses 
are not affected by their demographic backgrounds and allows us to neglect 


demographics in future analysis when considering this “overall” measure. 


TABLE 
ANOVA SIGNIFICANCE CUTCOMES USING THE SUM VARIABLE 


Dependent Variable: Summed Transformation Variable 


ANOVA KRUSKAL-WALLIS 


Classification 
ա 


Variables Levels Է 


obs obs 





Table 8 summarizes the ANOVA and Kruskal-Wallis test results using the 
selection variables’ first principle component as the dependent variable. Differences in 
classification means appear to be slightly significant at the .05 @ level, only when using 
FUNCAREA as the independent variable. The operational significance of these 
differences are inspected during the variable cluster analysis (Section J). Generally, 


demographics do not seem to have a significant effect on overall responses. 
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TABLE 8 


ANOVA SIGNIFICANCE OUTCOMES USING FIRST PRINCIPLE 
COMPONENT 


Dependent Variable: First Principle Component 


me. ANOVA KRUSKAL-WALLIS 
Classification 
Variables Levels کت‎ 10 5 1 abe 


TREAT 
RANK 
CIVED 
OFFBD 
BGBD 

SC 
FUNCAREA 





The third method of exploring for differences involved the use of ANOVA and 
the Kruskal-Wallis test on each selection variable taken separately. These tests show 
no significant differences in any of the selection variable responses due to officer 
selection board experience or Brigadier General selection board experience. Table 9 lists 
all tests (independent classification variable and the associated dependent selection 
variable) which were found to be significant. Except for under the classification 
variable, CIVED, all the dependent variables fall into two categories: military 
acquisition management (PPBS, ACQUIS, INDUS, PROGMGT) and warfare skills 
(TACTICS, STRAT). These groupings show that there is a diversity of opinion on the 
importance of these criteria. The significant variables and groupings are further 


analyzed in the bivariate and variable cluster analysis sections of the thesis. 


H. BIVARIATE ANALYSIS 
This section concentrates on identifying relationships between pairs of variables. 
The section is divided into two subsections; the first identifies possible trends within the 
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TABLE 9 


SIGNIFICANCE OUTCOMES USING INDIVIDUAL SELECTION 
VARIABLES 


INDEPENDENT VARIABLE 


FUNCAREA 





levels of a variable, and the second identifies relationships among the selection 
variables using correlation analysis. 
1. Demographic Influences 

The analysis of variance suggested a further inspection of several variables to 
determine whether demographic trends exist within the responses for an individual 
criterion. 

a. Effects of Civilian Education Level 

An interesting trend is displayed by the effect of civil education level on the 


importance of the civilian education criterion. There is a definite trend in the means of 
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the education levels. The means increase monotonically from those General Officers 
maintaining a BS/BA degree, to those with a MS/MA degree, followed by those with 
specialty degrees, and finally to those holding a PhD. The General Officers with higher 
degrees believe civilian education to be more important for selection. Table 10 displays 
the level means. 


— 


TABLE 10 


EFFECT OF CIVIL EDUCATION LEVEL ON 
CIVIL EDUCATION IMPORTANCE (MEANS) 


LEVEL MEAN 


Bachelors Degree 
Masters Degree 
Specialized Degree 
PhD 





The ANOVA also identified the variables, TACTICS and STRAT, to have 
significant differences of means under the CIVED classifications. The trend in these 
two variables is opposite from that of education importance. The importance of tactics 
and strategy for selection appears to be negatively correlated with education level. 
Overall, General Officers holding higher degrees tend to believe tactics and strategy to 
be less important. | 

b. Effects of Career Backgrounds on Selection 

The ANOVA process determined several variables to have significant 
differences under the specialty code and functional area classifications. Table 11 
displays the means for several of the variables partitioned by G.O. specialties or 
functional areas.The trends suggested to this author are indicated. General Officers 
with career backgrounds in combat arms tend to hold tactics and strategy to be more 
important for selection than do those with former specialties in combat service support. 


Similarly, an individual with an Operations and Plans secondary specialty considers 
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tactics and strategy to be relatively more important than does a respondent with an 
Automation Systems background. A General Officer with a former specialty in 
Contracting and Industrial Management believed industrial interaction to be more 
important than a person with the Operations or Foreign Area expertise. The results 
show that selection board members view certain criteria to be important based on their 


own career backgrounds. 


TABLE ld 


EFFECTS OF CAREER SPECIALTIES ON CRITERIA IMPORTANCE 
(EXAMPLES) 


CRITERION SPECIALTY or 
VARIABLE FUNCTIONAL AREA | MEAN TREND 


TACTICS Infantry High for combat 
Armor arms and opns/plans. 
. A. Low for non-combat 
Opns/Plans arms and service 
Automation specialties. 
Medical : 


INDUS Contracting Officers ۱ High for acquisition 
Opns/ Plans . and industria 
Foreign Area Opns j management. 
Medical ፡ Low for those 
specialties without 
industrial interaction. 


High for Combat 
arms. 





c. Effects of BGBD on PERSKNOW 
It is plausible that a person who has had the experience serving on a 
Brigadier General selection board may have a different opinion about the importance 
of a member's personal knowledge of a candidate. The effect of BGBD was tested on 
the variable, PERSKNOW. The classification distributions shown in Figure 4.8 


indicate a small amount of influence on the selection process, due to previous board 


ՎՀ 


experience. Persons who have had previous experience believe that personal knowledge 
plays a slightly greater role. Those individuals evaluated the importance to range from | 
moderately important (value 3) to extremely important (value 7), with 70% judging it 
to be in the top two values. General Officers without previous service on a Brigadier 
General selection board, evaluated the importance across the full range of values. 
Fifty-seven percent judged the importance to be in the top two categories. 
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Figure 4.8 Effects of BGBD on PERSKNOW. 


2. Correlation Analysis 

This subsection concentrates on identifying relationships between pairs of 
variables using the Pearson product-moment correlation matrix. The twenty-six 
selection variables are analyzed in this section. The correlation analysis forms a basis’ 
for the subsequent principle component analysis discussed in the next section. The 
purpose of correlation analysis is to identify those variables which have strong 
association. It does not show a cause and effect relationship between the variables. 
The correlation coefficient, p, has a range from -1 to +1. A value of +1 indicates an 
exact linear relationship between the variables. In other words, the high values of a 
variable occur with the high values or the other variable. A p value of -1 shows an 
exact inverse linear relationship where the high values of one variable occur with the 
low values of the other. A p value of 0.0 indicates that there is no linear relationship 
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between the two variables. The complete correlation matrix is given in A PEER F. 
The most significant observations are discussed below. 

The highest p value is 0.79 and the next largest absolute value is 0.65. The 
general absence of large correlations (in absolute value) indicate that the original 
criteria included in the survey tend to be uncorrelated and represent a wide scope of 
General Officer responsibilities. This also suggests that a principle component analysis 
to reduce dimensions may not be successful. 

Although the correlations generally are not strong, some of the variables have 
moderately high correlations which are believed to be due to imbeded test variables. 
As expected, there are relatively high correlations between the variables which were 
specificly included in the analysis to check for consistent responses (see Chapter 2, 
Section D). The correlation between TACTICS and STRAT is 0.79, indicating a 
response consistency. The set of variables PPBS, ACQUIS, PROGMGT, INDUS, and 
RESMGT) have pairwise correlations in the neighborhood of 0.50. Since the five 
variables do have common traits for military acquisition management or resource 
allocation, these correlations were expected. առ 

Other variables which display moderately large correlations are VERBCOM 
with WRITCOM (0.64), and the pairwise correlations of PUBREL, GOVTREL, and 
FORNREL. 

Although the above specified correlations are statistically significant, the 
majority of the Pearson product-moment correlations are low and significant variable 


relationships can not be extracted from the matrix. 


I. PRINCIPLE COMPONENT ANALYSIS 
1. Introduction - 
This section discusses the multivariate technique, principle component analysis 
(PCA), which was performed on the selection variables. There are three objectives to 
performing a PCA: 
1) Reduce the dimensionality of the data set 
2) Identify new, meaningful, underlying variables 


3) Eliminate original variables which contribute little extra information. 
[Ref. 6: p.106] 


Principle component analysis finds an orthogonal transformation of the original 
selection variables to a new set of uncorrelated composite variables, called principle 


components. Each principle component is a linear combination of the original 
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variables, representing some aggregate characteristic of the those variables. The 
combinations are constructed in such a way that the first principle component 
accounts for the largest proportion of variance and each successive composite variable 
accounts for a smaller proportion of the variance [Ref. 7: p.424]. In principle 
component analysis, a number of principle components equal to the number of original 
variables are required to account for 100% of the variance. Hopefully, most of the 
variance can be accounted for in the first few components, thereby allowing for 
dimension reduction. In line with the thesis objective, the reduced set of composite 
variables may be used as a basis for SBSS selection criteria. 

Principle component analysis operates on either a correlation or covariance 
matrix. For this study, the Pearson correlation matrix was used. The PCA computes a 
set of composite variables called eigenvectors, of the form: 


=> 


1 ነጠ = ajj oat 53) X5 t..t apj Xp (eqn 4.1) 
These composite variables represent a set of orthogonal components in 26 space (the 
space of the original variables). The corresponding eigenvalues represent the variance 
accounted for by the respective principle component. The new composite variable, or 
jth principle component, is represented in the notation by ነ; . The sign and magnitude 
of the loading coefficient a;; shows the direction and magnitude of the relationship 


0 ] 
between the composite variable Y; and the original variable X;. The principle 


] 
component is frequently interpreted in the terms of those variables having strong 
loading coefficients. Those selection variables with high loadings for a principle 
component can often be interpreted as displaying similar characteristics. [Ref. 7: p.425] 


» 


There are several "rules-of-thumb" for determining how many principle 
components to retain. The most popular selects a number of components which 
accounts for a specific cumulative fraction of the total variance (eg. 90%). Another 
rule-of-thumb selects those components with eigenvalues greater than or equal to one. 
The third method is based on a subjective interpretation of a scree plot. The final 
decision on the number of components to retain, is not based on a statistical 
requirement. Rather it is determined by good judgement and operational significance. 
2. Analysis 
The principle component analysis was performed on the twenty-six selection 


variables. Determination of the number of components to retain was difficult. Seven 
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## 


components would be selected using the criterion “eigenvalue 2 1.” The scree plot 


shown as Figure 4.9 shows a definite break at six principle components. 
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Figure 4.9 Scree Plot of Eigenvalues. : 


However, six or seven principle components do not explain an adequate 
amount of the variance. Only 56% of the variance is explained with six components 
and seven components accounts for only 60%. As indicated in Table 12, twenty-one 
components are required to account for 90% of the total variance and twelve principle 
components are needed to explain 75% of the variance. Table 12 displavs the 
eigenvalues for all twenty-six principle components. Column two shows the difference 
between the eigenvalues of successive components. The third column indicates the 
proportion of variance accounted for by each component and the last column displays 
the cumulative proportion of variance explained by the principle components. 

Consistent with the expectations based on the correlation analysis, the PCA 
did not yield operationally useful results. The principle component analysis takes a 
group of correlated variables and transforms them into uncorrelated composites. The 
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TABLE 12 


PRINCIPLE COMPONENT EIGENVALUES AND VARIANCE 
PROPORTIONS 


ETGENVALUE DIFFERENCE PROPORTION CUMULATIVE 


PRINI 
PRIN? 
PRINS 
PRING 
PRINS 
PRIN6 
PRIN7 
PRINS 
PRIN9 
PRINIO 
PRINII 
PRIN12 
PRINI3S 
ዞ፳፲ዘጊ4 
PRINI5 
PRIN16 
PRIN17 
PRIN18 
PRIN19 
PRIN2O 
Prone. 
PRIN22 
PRIN23 
PRIN24 
PRIN25 
PRIN26 


6.35086 
2.53789 
1.83378 
55951 
.09675 
.06002 
.97789 
.89070 
. 7 
.79852 
.69147 
.68707 
.6Գ502 
61912 
.58075 
.52548 
46222 


ፎር3ርፎጋ ርጋ ርጋ ርጋ ርጋ ርጋ ርጋ ፎጋ ርጋ ጋ ጋ <2 ፎጋ ፎጋ ጋ ጋ سم مٍ مر تن‎ 
՞ ՞ . e e ՞ 9 ՞ 


3.81298 
.70411 
.28528 
.16101 
.2927Գ 
.03673 
.08213 
.08720 
.06893 
.02325 
.10705 
.00ԳԳ0 


ت ت ت ت ፎጋ ርጋ‏ تو تن هته © © © © © 6 مه ه 


0.03970 
0.07807 


0.264266 
0.097611 
0.070530 
0.059635 
0.053442 
0.042183 
0.040770 
0.037611 
0.034258 
0.031606 


0.24426 
0.34188 
0.41241 
0.47206 
0.52548 
0.56767 
0.60844 
0.64605 
0.68030 
0.71191 
0.74262 
0.76922 
0.79564 
0.82038 
0.84419 
0.86652 
0.88673 
0.90374 
0.91921 
0.93432 
0.94861 
0.96107 
0.97287 
0.98393 
0.99347 
1.00000 





interpretation of the components is difficult. Table 13 displays an extract of the 
eigenvectors for the first seven principle components. The complete set of eigenvectors 
may be found at Appendix G. Most of the loading coefficients have values less than 
0.50 . Only five of the loadings exceeded 0.5 in all of the components. The linear 
combinations do not suggest new, meaningful composite variables with the possible 
exception of the first component. Although the first component loadings have small 
magnitudes, they are all positive. No one coefficient or small subset of coefficients 
“stand out” from the complete set. This suggests that the first principle component 
represents an "all around" or “whole person” criterion. The first component accounts 
for 24.4% of the total variance. 

The third objective of principle component analysis is to eliminate original 
variables which contribute relatively little extra information. Performing this analysis 
led to the elimination of four of the original variables, thereby slightly reducing the 
dimension. The method used the eliminate the variables consists of two steps: 
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: TABLE 13 
PRINCIPLE COMPONENT ANALYSIS EIGENVECTORS (EXTRACT) 


EIGENVECTORS 
PRIN1 PRINZ PRINS PRING PRINS PRING PRIN7 


TIS 128215 .075610 .203039 0.580570 ~-.016454 «212333 . 6 
PHYSFIT 158509 .17151Գ .119237 0.354514 021787 .262829 .294937 
MEE .173980 . 089054 .049265 0.479524 . 0829354 123272 .144802 
ASSIGN 156811 .068633 .100553 0.195233 .276809 .006475 . 407794 
PERFORM . 071552 .067025 .192161 0.184915 .1Գ5507 .455070 .435239 
CIVILED .e27 202 0174175 .032577 0.184283 .033962 .185293 . 6 
RESHGT .250761 .129078 .065271 >. 024059 .165599 .028504 . 9 
DECISN -1591553 . 075263 .262080 -.209805 -032999 0.091271 . ¿15971 
FORNREL - 245653 035936 .261775 0.007555 3 .035478 00749965 
PUBREL . 11 .137 6 .0085Գ5 071 . 356665 .064523 .017579 
GOVTREL «231997 . 0 .091349 -.121635 «417582 . 062946 .047271 
VERBCOM -217141 - 048591 .Գ14140 -.114580 - 049618 . 8 «130065 
WRITCOM » 233836 .099130 .257527 -.00608Գ .067447 26135317 .177 3563 
TECHEXP .063671 ~ 185208 -166960 -.114408 - 396451 347031 .098727 
INDUS - 270224 . 1 184872 >. 024570 .11Գ4517 . 6 . 1 
CONCEPT 168323 .006155 262556 —.295285 . 017339 .013471 . 98 
LEADER .112758 .180906 -266890 0.021185 . 050454 - 3680356 205356 
COMBAT © 136752 .525191 .079057 0.107846 .195065 2330552 .010291 
CMDPRES .207036 221171 -142391 0.106756 .020372 .114006 . 206778 
PEBS . 80262 .107343 070755 -.001862 . 4 -141145 . 9 
PROGMGT «251159 .197225 .111916 -.158065 . 5 .105806 . 0 
TIMEMGT - 220918 .015055 .200405 -.230153 155211 .137204 .0269Գ7 
TACTICS 086133 - 469654 .276980 Հ-.212Գ65 .034998 .017095 .026012 
ACQUIS 256595 . 9 .215854 -.066%62 - 221947 .101931 .125069 
JOINT .190939 5 .221618 -.047331 -151684 .065107 .298078 
STRAT - 068948 - 460754 .244757 =. 266745 .025757 .022516 060650 


መኔ(ዕኔ1 | OOO) | OOO | | O | ٠ ہ ہہ ہہ‎ 
١۱ ١ ههه ه‎ ه٥‎ ٥ ٢٥٥ ٥ه٥‎ ١٤٢ ١ ٥ ه١ هه‎ ه١‎ 
ه‎ ٥ ١١١١٢ ١ه راون أا‎ | ١٥١ ٥٣١٥ 


١ 111 1ፎ‏ ه ١‏ ه ١ 0ՍՕ ١‏ ه ه ١ ١‏ ه | ه ه | ه ه ه ه 
١ ١ ١ 1‏ هه ١‏ هه ١ l i | ١‏ ه هه هه ه ه ١‏ هه ١‏ ه 





1) Variables which maintain low loading coefficients in the eigenvectors but have 
high correlations with another variable are reviewed. 


2) Variables which have significant loadings only on the latter principle 
components are eliminated. A high loading in a component that explains a 
small amount of variance does not yield much information. 


The variables which were eliminated using these rules are: ACQUIS, VERBCOM, 
INDUS, and STRAT. Note that three of the variables (ACQUIS, INDUS, STRAT) 
have corresponding variables designed to test survey response consistency and therefore 
have high correlations (see Chapter 2, Section D). VERBCOM is highly correlated 
with WRITCOM and is therefore somewhat redundant. Elimination of variables 
reduced the number of selection variables from twenty-six to twenty-two. 

The principle component analysis did not yield the sought after reduction in 
dimensionality. Therefore, additional multivariate techniques, not included in the 
Original analysis plan were. utilized in order to develop the Brigadier General selection 
criteria. 
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J. VARIABLE CLUSTER ANALYSIS 

- This section concentrates on a dimension reduction technique called variable 
cluster analysis. Because the principle component analysis did not yield a reduced 
number of composite variables which could be meaningfully interpreted, the original 
analysis plan was extended to include this statistical technique. Variable clustering 
uses the correlation or covariance matrix to divide the variables into non-overlapping 
clusters. Consistent with the PCA, the correlation is used. Analyzing the correlation 
matrix causes all variables to be treated as equally important. Using the covariance 
matrix results in the variables with larger variances given more importance in the 
analysis [Ref. 8: p.802]. The effect of variable clustering is to produce clusters which 
can be interpreted as a new composite variable with a meaningful aggregated 
characteristic. This is similar to the purpose of a principle component analysis, 
however the variable cluster components are easier to interpret. 

1. Methodology 

Variable clustering commences with all variables in one group or cluster. The 
first two principle components are computed and an orthoblique rotation is performed 
on the eigenvectors. The variables are assigned to the rotated component with which 
they have the highest squared correlation. The following steps are then repeated: 
1) The first two principle components are found for each cluster of variables. 


2) The group which has the second highest eigenvector or explains the smallest 
amount of variation 1s chosen for splitting. 


3) An orthoblique rotation is performed. 


4) A variable is assigned to the rotated component with which it has the highest 
squared correlation. 


5) The variables are iteratively reassigned to clusters to maximize the variance 
accounted for by the group components. 


The steps are repeated until each variable forms its own cluster, thereby accounting for 
100% of the variance. [Ref. 8: p.802] 

The earlier ANOVA analysis performed on the first principle component with 
FUNCAREA as the independent variable (Section G), suggested looking at the effects 
of functional areas on the variable clustering. A variable clustering was performed for 
each functional area independently. Most cluster differences occured for functional 
areas which contained a single observation. These variable clusters are not 
representative of the General Officer population and thus were not considered for 
further analysis or implementation. Moreover, the clusters were not statistically or 


operationally significant. 
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2. Analysis | 

The variable cluster analysis was performed on the 22 selection variables, 
which were reduced from 26 variables by the principle component analysis. The 
twenty-two variables were clustered using the principle components as the cluster 
components. Since the Selection Board Support System can be adapted to allow as 
few as two selection criteria, or as many as ten; the maximum number of clusters 
generated was ten. | 

Table 14 gives the summary for ten clusters. In the column labeled “members” 
is the number of original variables assigned to each cluster. The column labeled 
“variation explained”, indicates the variation explained by the cluster component. It 
includes only contributions from the variables within that cluster. The proportion of 
varance explained is computed by dividing the amount of variance explained by the 
cluster by the total variance of the variables in the cluster. As indicated at the bottom 
of Table 14, the total proportion to the variance ‘explained in the 10 clusters is 
approximately 67%. The key as to whether this amount 1s sufficient to adequately 
explain the information in the original variables, is determined by the operational 
significance of the clusters. 


TABLE 14 
|... CLUSTER VARIATION SUMMARY 
OBLIQUE PRINCIPAL COMPONENT CLUSTER ANALYSIS 
CLUSTER SUMMARY FOR 10 CLUSTERS 


| CLUSTER VARIATION PROPORTION SECOND 
CLUSTER MEMBERS VARIATION EXPLAINED EXPLAINED EIGENVALUE 


.00000 
. 00000 
.00000 
.00000 
.00000 
.00000 


TOTAL VARIATION EXPLAINED = 14.7075 PROPORTION = 0.668515 
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ومومو‎ N 
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Table 15 indicates the names of the original variables assigned to each cluster. 
The clusters do appear to represent underlying meaningful variables which display 
operationally interpretable characteristics. The first cluster, containing the variables 
RESMGT, PPBS, and PROGMGT represents skills required in Resource Allocation 
Management. The variables, TIS, PHYSFIT, and MEL are grouped in the second 
cluster. This cluster suggests Overall Military Qualification. The third cluster 
represents Relational Skills and consists of the variables, FORNREL, PUBREL, 
GOVTREL, and CIVILED. Civilian education retains a weak correlation with the 
cluster as indicated in column 2 of Table 15. The inclusion of civilian education in this ` 
cluster is consistent with the Army Research Institute finding that graduate education 
in the field of international relations is valuable at the three and four star General 
Officer levels [Ref. 9: p.49]. The aggregated characteristic suggested by the variables, 
COMBAT and TACTICS, in the fourth cluster is War-Fighting Skills. Organizational 
Management Skills is established as the next cluster. The variables aggregated in this 
characteristic are: DECISN, CONCEPT, WRITCOM, and TIMEMGT. The sixth 
cluster represents Leadership by containing the variables, CMDPRES and LEADER. 
Clusters seven thru ten are univariate with each variable explaining its own cluster. 
Ihose clusters represent Technical Expertise, Assignment History, Duty Performance, 
and Joint Service Qualification. 

Columns two and three of Table 15 indicate the squared correlations of the 
original variables with their cluster and the next closest cluster component. A small 
value in the column labeled 1-K 2 indicates a good fit. [Ref. 8: p. 810] As 
mentioned earlier, CIVILED does not have a good correlation with either its own 
cluster or with the next closest cluster. It appears to be a good candidate for a 
separate cluster. | ۱ 

The clusters account for 67% of the variance. More importantly, they are 
operationally significant and represent logical groupings of the variables. They do 
represent aggregate characteristics of the original variables and provide a good basis 


for the final set of recommended criteria to be used with SBSS. 


K. SUBJECTIVE ANALYSIS 
The General Officers were given the opportunity to annotate additional criteria 
which they deemed important for selection. This section discusses the General Officers’ 


written comments 
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the respondents. 
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CLUSTER 


CLUSTER 


CLUSTER 


CLUSTER 


CLUSTER 
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CLUSTER 
CLUSTER 


CLUSTER 





TABLE 15 
CLUSTER FORMATION SUMMARY 


R-SQUARED WITH- 


OWN NEXT 1-R¥¥2 
VARIABLE CLUSTER CLOSEST RATIO 


1 کے‎ տաթ کے سے کے کے کے کے سے کے‎ տաթ տաթ «առ «առ: وس سے بو وس وس‎ «աջ. «աթ «աջ: «աջ «ռա» «առ سے سے سے سے سے سے سے سے‎ «առ «առ «ատ 
RESMGT 0.6294 0.1855 0.4550 
PPBS 0.7335 0.1916 6 
PROGMGT 0.7024 0.1862 0.3657 
ሯ- ----- ooo Հա ጨመ መ ጠመ «ոռ «առ «ոռ «ոռ «առ «աօ «առ «առ «աթ «առ. «աթ «առ «առ «առ «առ «առ «առ 
ԼՏ 0.4910 0.0482 0.5347 
PHYSFIT 0.6004 0.1402 0.4648 
MEL 0.5772 0.0798 0.4594 

ہے وس سے سے سے ہے سے کے کے کے کے سے وس وس «աթ «աթ «առ «աթ‏ وس دہ دہ دہ ہے کے کے کے کے وم دہ دہ کس کے መ ብ‏ ہے سے 3 
7852 0.2077 یے CIVILED‏ 
FORNREL 0.7026 0.1672 3571‏ 
PUBREL 0.6539 0.1669 4154‏ 
¿_SOVTREL___ 0.6301 0.1331 4267‏ 
COMBAT 0.6834 0.1613 3777‏ 
TACTICS 0.6834 0.0848 3459‏ 


0 
0 
0 
0 
0 
0 
LEADER - 0. 0 . ge 
CMDPRES 0.6814 0.2414 0.4200 
DECISN 0. 0 
WRITCOM - 0.4460 0 
CONCEPT 0 0 
TIMEMGT 0 0 
0 
0 
0 
0 


ys 
ር 





1. Analysis of Annotated Criteria 

Over 50 different additional criteria were annotated on the questionnaires by 
Many of these represented response by only a few respondents. 
There were, however, several recurring themes resulting from the additional criteria. 
The need for the selection board to consider interpersonal skills was the strongest of 
these. Several lengthy comments were written on interpersonal skills and the need for 


General Officers to possess the attribute. Strong feelings were expressed that General 
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Officers should have a genuine concern for subordinate soldiers and their families, 
.possess a high level of integrity, and utilize a high degree of common sense were also 
expressed. 

General Officers holding positions in medical related specialties (dentistry, 
veterinary medicine, etc) urged that Brigadier General selectees possess a national 
board certification in their field. 

Those criteria which were annotated on the-original survey in multiplicity are 
found in Table 16-with the frequency of their occurrences. Many of the criteria possess 
the aggregated characteristics determined in the Variable Clustering section and can be 
expressed as members of the clusters. 

2. Additional Comments 

In addition to providing input for specific selection criteria, several General 
Officers commented on special selection considerations. There were several comments 
concerning the need for a small number of Brigadier Generals to be selected on the 
basis of expertise in a specific specialty. One General stated, ".... I urge that both the 
selection boards and the GOMO in concert take care to select officers, hopefully a very 
small number, by virtue of their high performance in particular specialties /functions 
for related vacancies, and that officers selected for general performance be assigned to 
center-stream positions that better foster general development and progression. In 
concert with this theme, several General Officers expressed the opinion that several 
positions maintain a vertical learning curve for newly assigned Brigadier Generals. 

In addition, strong comments on the requirement for General Officers to 
possess interpersonal skills were reiterated. It was suggested that the selection system 
should weed-out people-eaters, those with egos that get in the way of performance, as 
well as those which do not have a genuine concern for soldiers. These are criteria 
which are difficult to measure by an individual's file. For determining these attributes, 
personal knowledge of the candidate is necessary. An interesting comment on the idea 
of personal knowledge was submitted by one General Officer. Paraphrasing, he said 
that personal knowledge is a "two-edged sword' and should not be considered a 
problem. It is an issue which can not be changed since senior officers develop 
reputations, good or bad, and some member of the board is bound to have knowledge 
of one or more of the candidates. Furthermore, he believed that it is impossible for a 


person to be selected for General Officer whose file does not support the selection. 
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TABLE 16 
FREQUENCY OF ANNOTATED CRITERIA 


CRITERION FREQUENCY 


Interpersonal Skills 15 
Concern for Soldiers 10 
Common Sense 

Integrity 


Reputation 


High Level Staff 
Relationships 


Trainer Ability 


Instalation Management 


8 
8 
Selflessness 1 
5 
5 


Logistics 

Moral Courage 

Language Skills 

Health Condition 

Team Building Ability 
Analytical Thought Process 


National Board Certification 
(Medical Specialties) 


WWW Ww UY Ja Un ی‎ 


Reserve Component Knowledge 


N N 


Spousal Support 


The comments prove to be strong concerns of the survey population. The 


comments are considered heavily in the final conclusions and recommendations. 
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V. CONCLUSIONS AND RECOMMENDATIONS 


- This chapter focuses on the study’s conclusions. A summary of the significant 
results from the analysis is presented. This is followed by a discussion of the 
conclusions drawn from the analysis. The most appropriate selection criteria are 
discussed, as well as several supplemental conclusions determined from the data. The 
basis upon Which each conclusion is developed Is explained. Next, recommendations 
are presented for approval and implementation. Concluding the thesis are 
recommendations for further study and research in related topics. 


A. SUMMARIZED RESULTS 
1. Exploratory Analysis 

The exploratory analysis provided an overview of the population 
demographics as well as an initial examination of the General Officers’ evaluations. 
The means and distribution analyses revealed that leadership, technical expertise, past 
performance, assignment history, decision making ability, and verbal and written 
communication skills are considered extremely important for selection to the rank of 
Brigadier General. 

These analyses also indicated that the vast majority of General Officers believe 
that they are appropriately assigned to a position congruent with their career 
background experience. They also believe they were better prepared for subsequent 
assignments versus their first assignment as a General Officer. 

2. Analysis of Variance and Kruskal-Wallis Tests 

The analysis of variance and Kruskal-Wallis test indicated there is no 
significant differences in the overall selection criteria evaluations due to the General 
Officers’ demographics. A statistically significant difference due to secondary 
specialties is indicated when the first principle component was used as the dependent 
variable. However, these differences are operationally insignificant. Several selection 
variables were identified as being individually significant due to specific demographical 
distinctions. These variables were examined for possible trends in the bivariate analysis. 

3. Bivariate Analysis 
The bivariate analysis exhibited several trends in the General Officers 


evaluations. First, the importance of the civilian education criterion monotonically 


ات 


increases with the level of degree possessed by the General Officers. Secondly, the 
General Officer career backgrounds affect the relative importance of several criteria. 
The Generals tend to evaluate higher those criteria which reflect their own career 
requirements. Finally, General Officers which have had previous experience serving on 
a Brigadier General selection board (versus those who have not) believe personal 
knowledge of a candidate is more important in the selection process. 

Correlation analysis of the selection variables indicated that overall there are 
low correlations among the variables. The original selection variables tend to be 
uncorrelated and thus provide a wide diversity of requirements placed on General 
Officers. Variables which represent criteria included in the survey to check for 
consistent responses possess relatively high correlations, indicating consistency. 

4. Principle Component Analysis 

Due to the low correlations between the original variables, the principle 
component analysis did not reduce the dimensionality of the data set through the 
transformed linear combinations. Generally, the principle componénts were difficult to 
interpret; however, the first principle component does suggest a criterion exhibiting a 
^whole-person" or “overall” aggregated characteristic. 

By examining the eigenvectors, four of the original selection variables were 
eliminated. These variables possessed low loading coefficients on the principle 
components. 

5. Variable Cluster Analysis 

The variable cluster analysis resulted in ten interpretable clusters of the 
twenty-two original selection variables. These clusters account for 67% of the variance 
and represent meaningful, aggregated characteristics. The clusters are operationally 
significant and form a basis for the final set of recommended selection criteria. 

6. Subjective Analysis 

The General Officers’ additional comments and annotated criteria presented 
several recurring themes which they believed important for selection to BG. 
Interpersonal skills, concern for soldiers, common sense, integrity, and selflessness were 


the most frequently mentioned. 


B. CONCLUSIONS 
The study’s initial conclusion is that the five criteria, presently utilized for 
selection boards through the grade of O-6, are not appropriate for Brigadier General 


selection. These criteria: qualification, performance, physical fitness and military 
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bearing, military education level, and civilian education level, do not convey the full 
scope of required General Officer attributes. Moreover, some provide little 
discriminatory power for the General Officer grades. 

The study also concludes that an appropriate set of Brigadier General selection 
criteria does exist. 

1. The Most Appropriate Selection Criteria 

. Ihe results of the variable cluster analysis form the basis for the set of 
Brigadier General selection criteria. The results of the cluster analysis can contribute 
directly to development of a classification scheme [Ref. 10: p.4]. 

There are ten criteria which can be considered most appropriate for selection 
to Brigadier General. Within several criteria, there are aspects or traits which should be 
considered during the evaluation of those criteria. | 

The first criterion is overall qualification. This criterion is developed based 
upon three sources of analysis: variable cluster analysis, principle component analysis, 
and subjective analysis. The PCA establishes that the overall qualification criterion is 
statistically significant and is necessary for selection.  Paralleling the PCA, the variable 
cluster analysis provides the criterion classification and exhibits several aspects which 
should be considered in the evaluation of this criterion. Those aspects are: time in 
service, physical fitness and military bearing, and military education level. In addition, 
several General Officer traits to be considered when evaluating this criterion are 
identified by the subjective analysis. They include: reputation, integrity, common 
sense, selflessness, and the candidate’s health. 

Relational skills is the next criterion. There are several categories of relational 
skills to recognize during evaluation. As established by the variable clustering; public, 
inter-governmental, and foreign (international) relational skills should be considered. 
The candidate’s civilian education in those skills should also be reviewed. Moreover, 
the General Officers additional comments direct that interpersonal skills and high level 
staff relational skills also be considered in the evaluation. 

The next criterion identified is Warfare Skills. Combat experience as well as 
tactics and strategy skills should be included within this criterion. 

Resource Allocation Management: is also established as a selection criterion. 
Aspects to be acknowledged under this criterion consist of: budgeting ability, PPBS 
knowledge, system acquisition skills, resource management ability, logistics skills, and 


program management ability. 
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Based upon both the variable clustering as well as the Title IV requirement, 
Joint Service Qualification is introduced as a selection criterion. Evaluation of this 
criteria should be based on the candidate's experience gained through joint service 
assignments as well as non-army military education. 

Technical Expertise is the next criterion to be evaluated during the BG 
selection process. The candidates expertise in specialized areas and civilian education 
degrees should be considered during this evaluation. As suggested by the subjective 
analysis, language skills can be acknowledged during this portion of the evaluation 
also. Furthermore, board members should recognize national board certifications for 
those in the medical and related fields. 

Another criterion is Organizational Management Skills. This classification is 
composed of decision making ability, written and verbal communication skills, time 
management ability, and the ability to conceptualize an organization’s future 
requirements should be considered. 

The last three clusters were comprised of a single criterion. Each is considered 
extremely important for selection. They are: Leadership Ability, Assignment History, 
and Duty Performance. 

These ten selection criterion are congruous with the requirements for 
implementation with the Selection Board Support System. Table 17 summarizes the 
ten selection criteria. The second column of the table indicates those aspects of the 
respective criteria which should be considered during their evaluation. 

2 Supplemental Conclusions 

Several findings were made during the course of the study which, although do 
not impact directly on determining the selection criteria, do present some interesting 
conclusions. 

Based on the bivariate analysis results, the conclusion can be drawn that 
selection board members tend to promote in their own image. The analysis revealed 
that career backgrounds affect the relative importance of selection criteria. In addition, 
those individuals with higher civilian education degrees generally considered civilian 
education more important. 

The means and frequency analysis showed that General Officers considered 
joint service skills to be relatively less important than many of the other criteria. These 
data were collected when the Title IV joint service requirement was relatively new and 
its impact not fully noted. A survey administered at the present time may receive a 


different response. 
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700۲ 
BRIGADIER GENERAL SELECTION CRITERIA 


Overall Military Qualification Time in Service 
Phvsical Fitness 
Military Education Level 
— Reputation 
—Common Sense 
— Integrity 
Selflessness | 
. Health Condition 


Relational Skills ~ Public Relations 


Inter-governmental Relations 
Foreign Relations 

Civilian Education (for above) 
- Interpersonal Skills 

High Level Staff Relations 


Resource Allocation Management ԱՏ Ki Ability 
Knowledge 
ystem Ac equisition Ability 
ار‎ A S 
Program Management Ability 


Technical Expertise Expertise in a Specialty 
Civilian Education Degree 





Organizational Management Skills  - کي‎ Making Ability 
Written Communication Skills 
- Verbal Communication Skills 
Time Management A bilitv 
Ability to Conceptualize * 


War-Fighting Skills Combat Experience | 
Tactics Skills | 


١ Strategy Skulls 
Joint Service Qualification 
Leadership. 


Assignment History 









Duty Performance 


. 
9 
. 
, 
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A conclusion drawn from background variable exploratory analysis indicates 
that, in general, Brigadier Generals believe that they are appropriately assigned to 
billets correlating to their career experiences. With the full implementation of the 
Executive Track decision support system, the assignment-experience correlation will be 
greatly enhanced. 

The analvsis of job preparedness showed that there are several positions which 
require specialized expertise. In addition, many General Officers feel better prepared 
for G.O. positions subsequent to their first G.O. assignment. 

Although there were diverse opinions on the subject, the study’s final 
conclusion indicates that personal knowledge of a candidate by a board member is 
relatively important. It allows for the evaluation of those attributes which are difficult 
to measure, and provides an opportunity to judge whether an individual will represent 


the army well, 


C. RECOMMENDATIONS 
1. Implementation of Selection Criteria 
We recommend that the ten selection criterra determined by this study 

be implemented with the Selection Board Support System for the Brigadier General 
selection process. At the commencement of the selection board, the criteria should be 
identified to the board members. Consistent with SBSS, the each board member will 
determine the relative weights to be applied to each criterion. Weight determination 
wil be based upon guidance from the Chief of Staff and personal perception of 
criterion importance. Ít is recommended that D.A. Secretariat staff personnel provide 
written instructions describing each criteria, as specified in Table 17, to be considered 
during the evaluation. This provides structure and consistency to evaluation process. 

It is further recommended that these criteria be utilized only to evaluate the 
candidates whose files are in the ’short-stack’. Employing ten criteria, SBSS detects 
subtle differences in evaluations and aids the board member with the final selection 
decision. This careful scrutiny of the files is not necessary for the initial screening and 
evaluation.: For the initial screening and evaluation, it is recommended the current 
SBSS criteria, performance and qualification, be utilized. 

Evaluation of the short-stack files with ten criteria will require time. It 1s 
therefore recommended the board members be alloted more time per file for this very 


important evaluation and decision. 
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The analysis indicated the existence of several General Officer positions which 
. require specialized expertise. -If possible, it is recommended that the GOMO identify 
annual impending vacancies for these specialized positions prior to the selection board 
convening. Selection of Brigadier Generals to fill these vacancies or meet specialty 
“floors” can be accomplished through the technical expertise criterion evaluation. Once 
all candidates have been evaluated, the order of merit list can be re-ordered by 
specialty and the technical expertise score. Individuals which meet the overall General 
Officer qualifications, and possess the greatest expertise in a specialty, can be identified 
to fill those specialized positions. ۱ 

Due to the finding that career backgrounds can influence criteria importance, 
it is recommended that selection boards be comprised of General Officers with varying 
career backgrounds and experience. 

2. Further Study And Research 

a. Immediate 

A committee should be established, in the short-term, to determine the 
sources from which board members can obtain relevant information for criteria 
evaluation. Several such sources are: Officer Record Brief, official photo, Officer 
Evaluation Reports, and personal knowledge of the candidate. The committee should 
determine if additional sources exist and how they can be included for the board 
members’ review. When selecting the army’s top leaders, it is important every available 
information source be utilized to insure the best decision. 

Prior to full scale implementation, the criteria should be tested by the next 
convening Brigadier General selection board in order to obtain constructive feedback. 
Upon completion of selection under the current system, it is recommended the board 
replicate the final selection from the short-stack using the ten selection criteria. 

b. Long Term 

The raw data and comments provided by the survey are useful for further 
analysis and study. It is recommended that the comments be reviewed to aid in the 
determination of which positions have specialized requirements. In concert with this, 
the responses can be used by the GOMO as a second validating source for the data 
base values assigned to the billet competencies of their management support system. 

Finally, further research is recommended to determine the feasibility of 
implementing an executive training program for newly selected Brigadier Generals. The 


responses to the questions addressing preparedness indicated that some Brigadier 
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Generals believe they could have been better prepared for their first G.O. position. 


The questionnaire data can be used as a basis to establish an appropriate professional 
development course. 
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APPENDIX A 
BRIGADIER GENERAL SURVEY 


خپ ee ee ee ee ee‏ چیہ چیہ چیہ چیہ Ee eb‏ هډ o‏ جه هډ دد پد جه eh ee‏ په WD‏ © 


MARK ALL ANSWERS DIRECTLY ON THE SURVEY QUESTIONAIRE 
BY CIRCLING APPROPRIATE ANSWER OR FILLING IN THE BLANKS 
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1. Circle your present rank. MG(P) MG BG(P) BG 
Q. What is your time in grade? (months) 


3. What is your current position and organization? 











4%. What was your former primary specialty? 


Տ. What was your former functional area or secondary specialty ? 





56. Circle highest civilian education. 


BS/BA MS/MA PhD Qther 


Major sub ject area? 





7. On how many officer selection boards have you served? 





8. Have you ever been a member of a Brigadier General selection 
board? 
Yes No 


9. In your opinion, how important to the selection process, is 
PERSONAL board member knowledge of the selectees’ potential 
as a General Officer? 


Extremely Moderately Signtly 
Important Important Important 
7 ሬ 5 6 3 2 1 


DOS How well were you prepared for your first BG position? 


Extremely Moderately Slightly 
prepared prepared prepared 
2 ሬ 5 & 3 2 1 
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ll. How well were you prepared for subsequent General Officer 
positions? 
Not applicable (currently serving in first BG position) 


Extremely - Moderately Slightly 
prepared prepared prepared 
7 ሬ 5 e 3 2 1 


12. Was your first job» as a BG, appropriate to your backround and 
experience. ' 


Extremely , Moderately Slightly 
appropriate appropriate appropriate 
7 & 5 & 3 2 1 


13. To best perform in your current position, please describe 
the subject areas in which you should possess expertise. 
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23. 
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Q7. 


For SELECTION ts BG, rate the following criteria: 


value for eacn criteria). 


Extremely 
Important 


(please specify) 
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Total Time in Service 7 
Physical Fitness / 

Military Bearing 7 
Military Éducation Level 7 
Types of Assignments Held 7 
Past Overall Performance 7 
Advanced Civilian Education 7 
Resource Management Ability 7 
Decision Making Ability 7 
Foreign Relation Skills 7 
Public Relations/Media Skills 7 
Inter-government skill 

(national, state, or local) 7 
Verbal Communication Skills 7 
Written Communication Skills 7 
Technical / Field Expertise 7 
Industry Interaction Ability 7 
Ability to Conceptualize 7 
Leadership Ability 7 
Combat Experience 7 
Command Presence 7 
PPBS Knowledge 7 
Program Management Ability 7 
Time Management Ability 7 
Knowledge of Tactics 7 
Acquisition/Procurement Skill 7 
Joint Service Knowledge 7 

' Tactics/Strategy Skills 7 
other ۱, 7: 2377780 7 
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Extremely 
Important 


Total Time in Service 7 
Physical Fitness / 

Military Bearing 7 
Military ር Level 7 
Types of Assignments Held 7 
Past Overall Performance 7 
Advanced Civilian Education 7 
Resource Management Ability 7 
Decision Making Ability 7 
Foreign Relations Knowledge 7 
Public Relations/Media Skilis 7 
Inter-governeent skill 
(national, state, local) 7 

Verbal Communication Skills 7 
Written Communication Skills 7 
ے۔‎ cGl / Field Expertise 7 
Industry [nteraction Ability 7 
Ability to Conceptualize 7 
Leadership Ability 7 
Combat Experience 7 
Command Presence i 7 
PPBS Knowledge 7 
Program Management Ability 7 
Time Management Ability 7 
Knowledge af Tactics 7 
Acquisition/Procurement Skill 7 
Joint Service Knowledge 7 
Tactics/Strategy Skilis 7 
Other 7 


(please specify) 
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APPENDIX B 
MAJOR GENERAL SURVEY 
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MARK ALL ANSWERS DIRECTLY ON THE SURVEY QUESTIONAIRE 
BY CIRCLING THE APPROPRIATE ANSWER OR FILLING IN THE BLANKS 
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13 Circle your present rank. MG(P) MG BG((P) BG- 


2. What is your time in grade? (months) 





3. What is your Current position and organization? 








4. What was your former primary specialty? 


S. What was your former functional area or secondary specialty 7 





56. Circle highest civilian education. 
BS/BA MS/MA PhD Other 


Major subject area? 





7. On how many officer selection boards have you served? 





8. Have you ever been a member of a Brigadier General selection 


board? 
Yes No 


9. In your opinions Row important to the selection process is 
PERSONAL board member knowledge of the selectees’ potential 
as a General Officer? 


Extremely Moderately Sligntly 
important important important 
7 5 5 te 3 2 1 


10. Qn the average, how well were the BGs that you supervise 
prepared for their first BG positions? 


Extremely Moderately Siggntiy 
prepared prepared . prepared 
Z 6 5 e. 3 2 1 
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11. To best perform in their current positions, please describe the 
subject area» in which the BGs that you supervise, should posses 
expertise? 


i 
፥ 


Subject areas 





Associated BG position: 





Subject area: 


- 
3 
՛ 


8. 
9. 
10. 


11. 


18. 
13. 
le. 
13. 
16. 
17. 
18. 
19. 
20. 
21. 
22 
cae 
24. 
23. 
26. 


57. 


for SELECTION to BG. rate tne following criteria. 


value for each criteria). 


Extremely 
[Important 


Total Time in Service 


Physical Fitness -/ 
Military Bearing 


Military Education Level 
Types of Assignments Held 
Past Overall Performance 
Advenced Civilian Education 
Resource Management Ability 
Decision Making Ability 
Foreign Relation Skills 
Public Relations/Media Skills 


[Inter-governeent skill 


(national, state» or local) 


Verbal Communication Skills 
Written Communication Skills 
Technical / Field Expertise 
Industry Interaction Ability 
Ability to Conceptualize 
Leadership Ability 


Combat Experience 


. Command Presence 


PPSS Knowledge 

Program Management Ability 
Time Management Ability 
Knowledge of Tactics 
Acquisition/Procurement Skill 
Joint Service Knowledge 1 


Tactics/Strategy Skills 


Other 





(please specify) 
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13. Far ane BG pasiticon whicm YOU SUPERV(Se. cate eéacn cf rnae criteria 


which are required to BEST PERFORM in tmat 605151 (Circle one value 
for each criteria) | [f you wish to rate the criteria for additional 


positions enich you supervise, feel free to reproduce this page, 
Complete ratings, ana attach to questionaire.) 


Pesition Title: 








Organizations : 
- 1 Extremely Moderately Slightly 
Important Important Important 
1. Total Years of Service 7 6 3 e 3 2 1 
2. Physical Fitness / : 
Military Bearing 7 ծ 35 e 3 2 լ 
3. Military Education Level 7 ند تت‎ 58 ሬ 3 2 1 
&. Types of Assignments Held 7 ሴ 3 ሬ 3 2 լ 
3. Past Overall Performance 7 4. J e 3 2 1 
&. Advanced Clvilian Education 7 6 3 & 3 2 1 
7. Resource Management A011ity 7 & 3. * 3 2 1 
8. Decision Making Abillty ? & 5 | do 3 2 1 
9. Foreign Relations Knowledge 7 Փ Ց لود و پوه‎ 
10. Public Relations Skills 7 d 3 ኢይ 3 2 1 
li. Inter-government skills 
(nationale. state» or local) 7 & 3 ሬ 3 2 1 
12. Verval Comaunication Skills ? & 3 4 3 2 1 
13. Written Communication Skllis 7 6 3 e 3 2 1 
1%. Technical / Field Expertise 7 ծ 3 & 3 2 1 
12 Industry Interaction ADillty 7 = 3 ዓ 3 2 1 
lé. Ability to Conceptual ize 7 6 3 & 3 2 1 
17. Leadership Abllity 7 & 3 ሩ 3 2 1 
19. Combet Exper lence 7 & 35 4 3 2 1 
19. Command Presence 7 6 3 & 3 2 1 
20. ۵39م‎ Knowledge 7 6 3 e 3 2 .1 
21. Program Management Ability 7 g 3 - 3 2 1 
22. Time Management Ability 7 ձ 5 & 3 e 1 
23. Knowledge of Tactics 7 & 5 e 3 2 1 
26. Acquisition/Procurement Skill 7 & 3 to 3 a 1 
23. Joint Service Knowledge 7 & 3 te 3 2 1 
26. Tactics/Strategy Skill 7 ձ 3 % 3 2 1 
Q7. Other 7 ፅ 2 օ 3 Յ 1 


(please specify) 
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APPENDIX C 
SURVEY COVER LETTER 


DEPARTMENT OF THE ARMY 


OFFICE OF THE DEPUTY CHIEF OF STAFF FOR PERSONNEL 
WASHINGTON, OC 20310-0300 





S: 10 March 1987 


be employed as integral elements of a newly developed executive decision 
support system for board member use. 


3. Your individual coments are welcome. To insure the mst candid response 
possible, only the summarized data will be permitted for FOUO release. Your 
responses are without attribution. 


4. Should you have questions concerning the survey, call either COL Jack 
Ferry, DAPC-3S, (A)221-9060, (00M) 202-325-9060 or MAJ Braddy, DAPC-PLE, 
(A) 221-0380, (COM) 202-325-0380. 


5. Your cooperation in timely completion of this survey is greatly 
appreciated. You will help to make a very qood selection process even better. 


ROBERT M. ELTON 
Lieutenant General, USA 
Deputy Chief of Staff 
for Personnel 
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APPENDIX D 
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APPENDIX E 
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